Cross-View Panorama Image Synthesis

نویسندگان

چکیده

In this paper, we tackle the problem of ground-view panorama image generation conditioning on top-view aerial image, which is a challenging due to large gap between domains associated with different view-points. Instead learning underlying cross-view mapping by feedforward network as previous methods, propose novel adversarial feedback GAN framework named PanoGAN consisting two key components: an module and dual branch discrimination strategy. First, fed into generator produce segmentation map, facilitates use semantic layout information for model training. Second, discriminator's feature responses outputs are encoded then back next round generation. Continual improvement generated quality achieved through iterative process. Third, pursue high-fidelity consistency pixel-segmentation alignment mechanism under discrimiantion strategy that promotes cooperation discriminator. Extensive experimental results datasets show proposed generates high-quality images more convincing details than state-of-the-art methods. The source code trained models available at https://github.com/sswuai/PanoGAN.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Cross-View Image Synthesis using Conditional GANs

Learning to generate natural scenes has always been a challenging task in computer vision. It is even more painstaking when the generation is conditioned on images with drastically different views. This is mainly because understanding, corresponding, and transforming appearance and semantic information across views is not trivial. In this paper, we attempt to solve the novel problem of cross-vi...

متن کامل

Image-based View Synthesis

We present a new method for rendering novel images of exible 3D objects from a small number of example images in correspondence. The strength of the method is the ability to synthesize images whose viewing position is signi cantly far away from the viewing cone of the example images (\view extrapolation"), yet without ever modeling the 3D structure of the scene. The method relies on synthesizin...

متن کامل

Image Based View Synthesis

This dissertation deals with the image-based approach to synthesize a virtual scene using sparse images or a video sequence without the use of 3D models. In our scenario, a real dynamic or static scene is captured by a set of un-calibrated images from different viewpoints. After automatically recovering the geometric transformations between these images, a series of photo-realistic virtual view...

متن کامل

Image Based View Localization System Retrieving from a Panorama Database by SURF

We propose a system for estimating a user’s view direction with its location of a captured image by retrieving its corresponding region from panoramas in a database. In our database, 104 panoramas captured within a local area are stored. For retrieving a user’s location, the query image captured by the user’s planarprojection camera is compared with all the panoramas in the database. SURF is us...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Transactions on Multimedia

سال: 2022

ISSN: ['1520-9210', '1941-0077']

DOI: https://doi.org/10.1109/tmm.2022.3162474